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ABSTRACT 


Limits  of  Pattern  Discrimination  in  Human  Vision 

The  studies  reported  in  Annual  Technical  Report  1  were  designed  to  probe 
various  aspects  of  spatial  pattern  discrimination.  Several  important  findings 
have  emerged  allowing  limits  of  pattern  discrimination  to  be  related  to  structural 
properties  of  the  photoreceptor  lattice.  First,  our  findings  have  suggested 
that  spatial  frequency  discrimination  exceeds  resolution  of  the  photoreceptor 
mosaic  for  spatial  frequencies  above  approxomately  4  c/deg,  thus  spatial 
frequency  discrimination  qualifies  as  a  hyperacuity  task.  Further,  spatial 
frequency  discrimination  was  not  a  smooth  function  of  spatial  frequencv,  but 
rather  showed  a  regularly  segmented  structure  that  appeared  to 
be  related  to  foveal  photoreceptor  center-to-center  spacing.  This  result 
suggests  that  the  photoreceptor  lattice  could  be  the  primary  geometrical 
instrument  for  estimating  distance  or  separations  between  stimulus  features. 

In  addition  to  our  study  of  spatial  discrimination,  we  have  developed 
a  technique  to  study  the  structural  quality  of  a  retinal  mosaic  by  digitizing 
the  foveal  photoreceptor  lattice  of  a  primate  (Macacca  fascicularis) .  Our  analyses 
of  the  foveal  region  has  revealed  a  very  high  quality  hexagonal  lattice  with 
a  correlation  length  of  at  least  130  photoreceptors.  These  results  confirm 
that  the  photoreceptor  lattice  is  constructed  with  sufficient  structural  quality 
to  provide  a  source  of  geometrical  information  reflected  in  spatial  discrimination 
tasks. 

A  logical  consequence  of  the  above  argument  that  cortical  image  processing 
for  spatial  discrimination  tasks  may  reflect  the  one  dimensional  organization 
(center-to-center  spacing)  of  the  retinal  photoreceptor  lattice  is  that  the 
same  processing  also  reflects  the  two  dimensional  structure  (hexagonal)  of 
the  photoreceptor  lattice.  A  study  of  spatial  frequency  discrimination  and 
vernier  acuity  as  a  function  of  orientation  showed  a  substantial  60  period 
suggesting  that  indeed  such  a  model  was  plausible.  We  have  proposed  a  specific 
model  (referred  to  as  the  Scaled  Lattice  Model  of  Spatial  Vision)  that  relates 
spatial  frequency  discrimination  and  the  photoreceptor  lattice.  Briefly,  the 
model  suggests  that  spatial  intervals  are  measured  by  counting  points  on  the 
neural  lattice  between  the  relevant  stimuli.  There  exist  multiple  neural  scales 
each  related  to  the  fundamental  photoreceptor  unit  size.  A  scale  selection 
mechanism  exists  that  determines  the  sampling  scale  and  interpolation  factor 
such  that  the  effective  lattice  spacing  is  roughly  proportional  to  the  spatial 
scale  of  the  measurement. 

The  generalizability  of  the  Scaled  Lattice  Model  was  tested  in  an 
experiment  where  our  measurements  were  extended  to  frequencies  as  low  as 
0.3  c/deg.  For  this  new  range  of  spatial  frequencies  (0.3  -  2  c/deg)  we 
find  a  similar  segmented  structure  with  e  equal  to  about  0.056  deg  or  7  times 
the  foveal  photoreceptor  spacing.  We  attribute  this  to  spatial  sampling  by  an 
array  of  retinal  receptive  fields  (which  we  call  spatial  sampling  fields) , 
and  interpret  this  finding  as  support  for  the  fundamental  contribution  of 
the  photoreceptor  lattice  to  spatial  disariminattrimn. 
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A.  OBJECTIVES  OF  THE  RESEARCH  EFFORT 


1.  To  study  how  the  limits  of  spstisl  frequency  discrimination  are  related  to 
hyperacuity  performance  and  neural  interpolation, 

2.  To  investigate  the  quality  of  the  primate  photoreceptor  lattice  and  relate 
the  structural  properties  of  the  foveal  retinal  mosaic  to  the  'neural  metric' 
employed  in  hyperacuity  tasks, 

3.  To  study  how  spatial  frequency  discrimination  varies  as  a  function  of 
stimulus  orientation, 

4.  To  determine  the  limits  of  spatial  frequency  discrimination  for  very  low 
spatial  frequencies, 

3.  To  develop  a  model  of  spatial  discrimination  that  accounts  for  the  above 
findings. 


B.  STATUS  OF  THE  RESEARCH  EFFORT 

1.  LIMITS  OF  SPATIAL  FREQUENCY  DISCRIMINATION  AND  RELATION  TO  HYPERACUITY 
PERFORMANCE. 


The  accuracy  with  which  the  human  visual  system  is  able  to  estimate  positions 
of  lines  (as  in  the  case  of  vernier  acuity)  exceeds  the  resolution  of  the 
photoreceptor  mosaic.  This  extraordinary  sense  of  image  position  requires  some 
form  of  neural  interpolation  in  order  to  achieve  snch  a  fine  grained 
representation. 1>2, 3  in  recent  years  much  attention  has  been  given  to  the  spatial 
frequency  properties  of  the  eye.  However,  the  limits  of  supra threshold  frequency 
discrimination  have  not  previously  been  related  to  the  limits  of  separation 
discrimination.  In  this  study  we  investigate  the  role  of  neural  interpolation  in 
spatial  frequency  discrimination  tasks.  We  find  that  the  limits  of  spatial 
frequency  discrimination  require  resolution  finer  than  the  size  of  a  single 
photoreceptor,  and  that  performance  on  this  task  is  very  similar  to  performance  on 
separation  discrimination  tasks.  We  also  find  that  spatial  frequency 
discrimination  is  not  a  smooth  function  of  frequency,  but  rather  has  a  regularly 
segmented  structure. 


METHODS  AND  PROCEDURE 

Stimuli  were  vertical  sinusoidal  spatial  frequency  gratings  electronically 
generated  on  the  face  of  a  CRT  (Tektronix  606,  P31  phosphor).  The  gratings  were 
calculated  by  a  PDP  11/03  computer  and  stored  in  digital  display  generating 
hardware. 

Sessions  were  controlled  by  the  laboratory  computer,  and  the  data  analysis 
followed  each  experimental  session.  The  data  were  gathered  over  a  period  of  18 
months  in  irregular  order. 
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The  observer  initiated  a  trial  by  pressing  a  ready  key.  A  trial  consisted  of 
a  reference  grating  presented  for  1.3  sec,  an  interstiaulus  interval  of  .75  sec, 
and  a  test  grating  presented  for  1.5  sec.  All  stianli  were  stationary  with  abrupt 
on  and  offsets,  and  the  phases  of  both  the  test  and  reference  gratings  were 
independently  randoaized  on  each  trial.  Onsets  of  both  reference  and  test  gratings 
were  cned  by  a  tone.  A  response  period  followed  the  test  stianlns  and  was 
indicated  by  a  beep  and  an  LED  alphanuaeric  display  located  to  the  side  of  the 
screen. 


The  observer’s  task  was  to  decide  if  the  test  grating  had  a  higher  or  a  lower 


spatial  frequency  than  the  reference  grating.  A  two  alternative  forced  choice 
aethod  was  eaployed  where  the  observer  signaled  a  'high*  or  ’low*  response  by 
pressing  the  appropriate  key  on  a  response  panel.  Following  each  response  a 
synthesized  voice  unit  (Votraz  VSR)  replied  either  ’high’,  'low',  or  ’saae’ 
indicating  whether  the  test  grating  presented  on  that  trial  had  been  a  higher 
spatial  frequency,  a  lower  spatial  frequency,  or  the  saae  spatial  frequency  as  the 
reference  grating. 


Seven  test  gratings  were  eaployed  during  each  session.  Three  were  of  lower 
spatial  frequency  than  the  reference  grating,  three  were  of  higher  spatial 
frequency  than  the  reference,  and  one  was  the  saae  spatial  frequency  as  the 
reference.  Test  grating  frequencies  were  chosen  syaaetrically  about  the  reference 
frequency.  All  reference  gratings  were  presented  at  30%  contrast.  Prior  to  the 
sessions,  a  contrast  aatching  ezperiaent  was  done  so  that  each  test  grating  had  the 
saae  apparent  contraat  as  the  reference  grating. 4  In  addition,  on  each  trial  the 
contrasts  of  both  the  test  and  reference  gratings  were  given  saall  randoa 
variations  (between  +  1  db)  to  farther  ensure  that  no  contrast  cues  existed.  All 
test  gratings  were  randoaized  and  presented  with  equal  probabilities.  Each  test 
grating  was  presented  50  tines.  A  session  consisted  of  350  trials  plus  20  initial 
practice  trials  that  were  excluded  froa  the  data  analysis. 


The  probability  of  a  'high*  response  was  fit  to  a  cuanlative  noraal 
distribution  described  by  two  paraaeters,  fc  and  Af.  The  value  of  fc  is  the 
frequency  at  which  the  probability  of  a  ’high’  response  is  .50,  and  Af,  the  just 
discriainable  difference  (jnd)  in  spatial  frequency,  is  proportional  to  the  width 
of  the  noraal  distribution  with  a  constant  scale  factor  chosen  so  that  the 
probability  of  a  correct  response  is  .75  when  f-fe  equals  Af.  (Af  equals  .68 
tines  the  standard  deviation  of  the  fitted  noraal  distribution.)  The  fit  was  aade 
using  the  aethod  of  aaxiaua  likelihood  and  also  yielded  estiaates  of  the 
statistical  errors  for  both  paraaeters.  The  estiaated  error  bars  were  verified  by 
replicating  a  nuaber  of  points  over  tine.  Chisquared  values  calculated  for  the 
fits  indicated  good  agreeaent  between  the  fit  and  the  data  in  all  cases,  and  fc 
did  not  differ  significantly  froa  the  reference  frequency. 


RESULTS 


Discrlaination  as  a  function  of  spatial  frequency 


Three  observers  (JH,  BA,  and  KM)  with  uniapaired  vision  participated  in  the 
ezperiaent.  Data  froa  each  are  shown  in  Figures  la,  lb,  and  lc  respectively. 


FIG  1 
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Values  of  Af/ f  (where  Af  is  defined  above  and  f  is  the  reference  frequency)  are 
plotted  against  the  reference  frequency.  Each  point  represents  one  session  and 
errors  on  each  point  are  estinates  from  the  fitting  procedure.  The  data  are 
clearly  not  a  saooth  function  of  frequency  but  rather  show  a  segmented  structure 
for  all  observers.  Further,  the  data  are  not  well  fit  by  a  single  straight  line 
(chisquared  confidence  levels  less  than  .05  in  all  three  cases). 

Examination  of  the  data  yields  several  significant  characteristics  of  the  Af/f 
vs  f  function.  First,  the  Af/f  function  can  be  divided  into  several  segments.  The 
segments  occur  at  approximately  the  same  place  for  all  observers,  and  are  separated 
by  transition  regions  where  Af/f  falls  rapidly  with  spatial  frequency.  The 
transitions  appear  nearly  regularly  spaced  in  spatial  frequency,  repeating  about 
every  four  cycles/deg.  Peak  values  of  Af/f  are  about  the  same  for  each  segment 
across  all  observers,  with  a  value  of  approximately  .032.  Within  each  segment  Af/f 
rises  with  spatial  frequency  (following  the  transition),  and  the  points  are 
clustered  around  straight  lines  drawn  through  the  origin.  These  lines  are  drawn  in 
Figures  la,  lb,  and  lc,  and  the  derivationa  are  discussed  below.  The  slopes  of 
these  lines  vary  systematically  from  segment  to  segment.  Disregarding  the 
segmentation,  it  can  be  seen  from  Figure  1  that  Af/f  is  essentially  independent  of 
spatial  frequency.  This  observation  suggests  that  over  the  range  of  spatial 
frequencies  studied  the  visual  system  on  the  average  achieves  a  resolution  which  is 
a  constant  fraction  (approximately  .025)  of  the  size  of  the  relevant  visual 
characteristic. 


In  a  second  set  of  measurements  all  gratinga  were  presented  as  described  above 
except  that  the  extent  of  sinusoidal  modulation  for  both  test  and  reference 
gratings  in  a  particular  session  was  restricted  to  a  region  of  constant  angular 
width  less  than  the  fall  screen.  The  phases  were  randomized  as  described  above  and 
the  modulation  was  abruptly  reduced  to  zero  outside  the  display  region.  Both  test 
and  reference  gratings  remained  centered  in  the  fonr  degree  field.  Figure  2  shows 
Af/f  as  a  function  of  the  number  of  cycles  in  the  reference  grating  for  observer  BA 


FIG  2 


and  spatial  frequencies  of  4,  8,  and  12  cycles/deg.  Similar  results  were  found  for 
observer  JH.  In  all  cases  it  can  be  seen  that  the  Af/f  function  is  independent  of 
field  size  until  the  field  size  becomes  less  than  two  cycles.  The  scatter  in  the 
data  for  field  sizes  of  two  cycles  and  above  is  consistent  with  the  error  bars  on 
each  point.  We  interpret  this  as  evidence  that  the  spatial  frequency 
discrimination  was  in  fact  done  by  measurement  of  the  separation  between  two  visual 
features  separated  by  exactly  one  spatial  cycle.  In  particular,  if  the  task  were 
based  on  measurement  of  the  distance  between  two  successive  peaks,  performance 
would  degrade  rapidly  as  field  size  became  less  than  two  cycles  because  a  random 
sample  of  a  sine  wave  becomes  increasingly  less  likely  to  contain  two  intact  peaks 
as  the  sample  width  decreases  below  two  cycles.  A  sample  containing  only  one  cycle 
cannot  contain  two  intact  peaks. 
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Discrimination  of  separations  between  line  pairs 

The  assumption  that  discrimination  between  spatial  frequency  gratings  is 
primarily  dependent  upon  the  distance  between  two  luminance  peaks  was  further 
tested  in  a  third  experiment.  This  experiment  was  similar  to  the  spatial  frequency 
discrimination  experiments  described  above  except  that  a  single  pair  of  very  thin 
vertical  lines  on  a  dark  background  was  presented  instead  of  a  spatial  frequency 
grating.  The  task  for  the  observer  was  to  decide  if  the  separation  between  the 
test  pair  of  lines  was  greater  or  less  than  the  separation  between  the  reference 
pair  of  lines.  Deviations  of  test  separations  from  reference  separations  were 
controlled  to  an  accuracy  of  better  than  10“4  degrees,  and  the  center  of  each 
pair  of  lines  was  independently  randomized  around  the  center  of  the  display  by  + 

1/4  of  the  reference  separation.  In  all  other  respects,  this  experiment  was  the 
same  as  the  spatial  frequency  experiments.  Data  from  each  session  were  analyzed  as 
above  to  obtain  estimates  of  the  center  separation,  the  jnd  in  separation  As,  and 
the  error  on  each.  The  results  for  this  experiment  are  shown  for  observer  JH  in 
Figure  3.  The  fractional  resolution  in  separation.  As/s,  is  plotted  against  the 
inverse  of  reference  separation,  1/s.  Both  axes  of  this  graph  are  dimensionally 


FIG  3 


directly  comparable  to  those  of  Figure  1.  The  similarity  between  the  data  in 
Figures  1  and  3  is  striking.  The  separation  discrimination  data  clearly  shows  the 
same  segmentation  as  was  observed  in  the  spatial  frequency  discrimination  data. 

The  only  significant  disagreement  between  the  two  sets  of  data  is  in  the  region 
between  3  and  4  deg~l  where  the  separation  discrimination  data  makes  the 
transition  between  the  first  and  second  segments  earlier  and  somewhat  more 
gradually  than  the  frequency  discrimination  data.  Similar  results  were  found  for 
another  observer,  JM.  It  is  interesting  that  greater  differences  were  not  observed 
especially  in  the  low  frequency  region  where  the  curvature  of  the  peaks  for  the 
line  stimuli  (determined  by  the  line  spread  function)  was  considerably  greater  than 
the  curvature  of  the  corresponding  sinusoidal  stimuli. 


Spatial  frequency  discrimination  as  a  width  discrimination  task 

Given  the  assumption  that  the  critical  visual  feature  for  the  sinusoidal 
spatial  frequency  discrimination  task  was  the  separation  between  two  successive 
peaks,  we  can  convert  from  the  jnd  in  spatial  frequency  (Af)  to  a  jnd  in  visual 
angle  (As).  The  separation  between  cycles  in  degrees  is  given  by 

s  -  1/f  (1) 

where  f  is  the  spatial  frequency  of  the  reference  grating.  Differentiating 
equation  1  shows  that 


As  -  Af/f2 


(2) 


It  is  also  useful  to  note  that  the  fractional  resolution  in  spatial  frequency  is 
equal  to  the  fractional  resolution  in  angular  separation.  This  is  shown  by 
rewriting  equation  2  in  the  form: 
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Anaular  resolution  for  discrimination  tasks  it  less  thin  the  spacing  between 
photoreceptor* 

In  Figure  4m  the  spatial  frequency  data  for  observer  JH  are  replotted  in  terns 
of  As  and  compared  to  the  separation  discrinination  data  shown  in  4b.  Also  shown 
in  Figure  4b  are  results  of  a  similar  line  pair  experiment  previously  reported  by 


FIG  4 


Westheimer?  (open  symbols)  which  are  consistent  with  our  observations.  From  this 
figure  it  can  be  seen  that  the  angular  resolution  As  for  both  tasks  is  much  smaller 
than  the  spacing  between  photoreceptors  for  medium  and  high  spatial  frequencies. 

(As  a  point  of  reference,  the  size  of  a  photoreceptor  is  estimated  to  be  about  30 
secs  of  arc  or  .008  degrees?.) 

As  noted  above,  the  data  in  Figures  1  and  3  cluster  about  straight  lines  drawn 
through  the  origin  in  the  Af/f  vs  f  plane.  Rewriting  equation  2  in  the  form 

Af/f  -  As*f  (2.2) 

shows  that  such  lines  represent  regions  of  constant  As.  These  lines  are 
transformed  to  the  horizontal  dashed  lines  in  Figure  4.  We  see  that  As  as  a 
function  of  f  has  a  step-like  form  and  that  the  segments  described  in  Figures  1  and 
3  are  regions  of  constant  As.  The  values  of  As  are  very  nearly  the  same  for  the 
frequency  discrimination  data  and  the  separation  discrimination  data. 

DISCUSSION 

A  key  argument  made  above  ia  that  the  sinusoidal  frequency  discrimination  task 
was  done  by  locating  specific  features  of  the  stimulus  separated  by  exactly  one 
cycle,  presumably  two  successive  peaks,  and  measuring  the  distance  between  them. 

The  evidence  for  this  is  found  in  the  field  size  and  line  pair  separation 
discrimination  results.  The  field  size  data  clearly  show  that  the  task  required 
more  than  1/2  cycle  and  less  than  two  cycles  of  the  spatial  frequency  grating. 

More  deciaive  evidence  is  shown  in  Figure  4  where  we  see  that  the  spatial  frequency 
discrimination  reaults  and  the  separation  discrimination  results  are  almost 
identical  when  related  by  this  assumption  (equations  1  and  2).  We  have  not  shown 
conclusively  that  the  relevant  features  for  the  sinusoids  are  two  successive 
peaks.  However,  we  have  shown  that  the  task  involved  two  well-defined  features 
separated  by  exactly  one  cycle.  The  only  possibilities  for  the  relevant  features 
are  two  successive  peaks  or  two  successive  valleys  since  'zero  crossings’  are 
separated  by  only  one  half  cycle  and  'zero'  is  not  well  defined  (particularly  in 
the  field  size  experiments)  since  there  was  generally  not  an  integral  number  of 
cycles  in  the  display.  Luminance  peaks  (or  valleys)  occur  in  essentially  all 
visual  stimuli,  and  a  mechanism  which  locates  these  features  would  be  generally 
applicable.  Weatheimer  and  McKee  have  shown  that  hyperacuity  comparable  to  that 
reported  here  occurs  in  a  wide  variety  of  visual  tasks  and  has  little  or  no 
dependence  on  the  exact  stimulus  employed. 5, 6 
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These  results  would  be  difficult  to  interpret  in  terms  of  a  global  model  where 
the  detector  involves  several  or  many  cycles.  In  particular,  the  Fourier  spectrum 
of  a  sine  wave  sample  consisting  of  only  one  cycle  is  very  broad  with  a  width  of  50 
to  100%  of  the  center  frequency,  and  a  line  pair  is  not  usefully  described  in  terms 
of  its  Fourier  spectrum.  Hence,  the  similarity  of  the  results  would  be  difficult 
to  explain  in  terms  of  their  spatial  frequency  content.  However,  a  model  dependent 
upon  the  separation  between  the  luminance  peaks  of  the  stimulus  would  predict  the 
same  results  for  both  experiments.  We  also  note  that  once  the  field  size  has 
exceeded  two  cycles,  no  further  improvement  is  observed  in  discrimination.  If  any 
form  of  non-local  summation  existed,  it  would  be  expected  that  Af  would  decrease 
with  increasing  field  size.  Even  simple  averaging  of  the  widths  of  many  separately 
measured  cycles  would  lead  to  decreases  in  Af  proportional  to  1/  field  size  .  The 
visual  system  apparently  does  not  exploit  non-local  information  for  this 
discrimination  task. 


2.  QUALITY  OF  THE  PRIMATE  PHOTORECEPTOR  LATTICE  AND  SPATIAL  DISCRIMINATION 


There  is  a  growing  recognition  that  the  photoreceptor  lattice  must  play  a 
fundamental  role  in  spatial  vision. i^e  question  of  how  accurately  the 
photoreceptors  are  placed  in  the  lattice  then  becomes  of  considerable  importance, 
and  two  quite  different  views  of  the  consequences  of  imperfections  in  the  lattice 
have  been  proposed.  We  have  recently  presented  evidence  suggesting  that  spatial 
intervals  are  measured  by  counting  points  in  a  cortical  lattice  which  is  derived 
from  the  photoreceptor  lattice.  From  this  point  of  view,  the  photoreceptor  lattice 
is  the  basic  geometrical  instrument  for  measuring  distances  and  any  randomness  in 
the  spacing  of  photoreceptors  will  limit  the  accuracy  with  which  the  measurements 
can  be  made. 


METHODS 


To  study  the  question  of  photoreceptor  lattice  quality  we  have  analyzed  the 
foveal  cone  mosaic  from  an  adult  primate  (Macaca  fascicularis)  using  an  electron 
micrograph  of  a  section  taken  tangent  to  the  external  limiting  membrane  (ELM)  close 
to  its  scleral  side  (Miller,  1979). Our  analysis  is  based  on  measurements  of 
the  positions  of  the  centers  of  about  100  cone  inner  segments  in  the  central  fovea 
(Fig.  5).  This  lattice  was  chosen  for  analysis  rather  than  that  published  by 


FIG  5 


Polyak  (19S7)  and  studied  by  Yellott  (1982)  because  the  Polyak  lattice  is  a 
photograph  of  a  whole  mount  that  appears  to  be  focused  near  the  level  of  the  outer 
segments.  The  outer  segment  locations  are  irrelevant  for  positional  analysis  since 
the  outer  segments  are  basically  light  guides  for  photons  that  enter  the  cones  at 
the  inner  segments.  The  outer  segments  may  also  be  subject  to  substantial 
positional  distortion  since  they  are  embedded  in  a  semifluid  extracellular  matrix. 
In  contrast,  the  positions  of  the  inner  segments  are  fixed  at  the  ELM  by 
desmosomes,  after  which  they  taper  and  increase  in  refractive  index  to  become  light 
guides,  providing  the  mechanism  by  which  the  cones  form  separate  optical  channels. 
Thus  the  inner  segment  at  the  ELM  is  the  spatial  aperture  of  the  cone  for  its 
photon  catching  function  and  its  position  specifies  cone  location  for  the  purpose 
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of  image  reconstruction.  We  further  note  that  the  Miller  lattice  displays  clearly 
higher  spatial  quality  than  the  Polyak  lattice.  Given  the  unlikelihood  of 
accidentally  introducing  order  into  an  initially  disordered  lattice,  the  more 
orderly  lattice  must  be  more  representative  of  the  intact  retina. 


RESULTS 


Pig.  6^is  a  histogram  of  the  distances  between  the  centers  of  all  pairs  of 


FIG  6 


photoreceptors  in  our  sample.  There  is  a  very  distinct  peak  corresponding  to  the 
nearest  neighbor  distance  (which  we  call  ring  1).  The  ms  width  of  the  peak 
(standard  deviation  of  the  nearest  neighbor  distance)  is  .077  times  the  mean 
separation  between  nearest  neighbor  photoreceptors  and  drops  to  .070  when  the 
contribution  from  our  measurement  error  is  removed.  This  is  comparable  to  the 
maximum  tolerable  spacing  error  (.078)  estimated  below  from  human  psychophysical 
results. 


Fig. 


1m 


6Ashows  a  histogram  of  the  angles  between  the  horizontal  axis  and  the 


lines  connecting  the  center  of  each  photoreceptor  to  the  center  of  its  nearest 
neighbors  where  nearest  neighbors  are  defined  as  any  pair  whose  center  to  center 
separation  is  less  than  the  maximum  nearest  neighbor  distance  shown  in  2a.  This 
figure  shows  a  well  defined  set  of  directions  with  hexagonal  symmetry  (60*  spacing) 
which  determine  the  orientation  of  the  lattice,  and  is  consistent  with  previous 
qualitative  observations  of  retinal  structure.11 (It  has  been  pointed  out  to 
us  that  the  packing  of  the  lattice  approximates  a  hexagonal  tessellation  with  the 
centers  of  the  receptors  forming  a  triangular  lattice.) 


By  specifying  the  mean  nearest  neighbor  distance  and  orientation  of  the 
lattice  we  have  fully  determined  the  basis  vectors  for  the  lattice.  (See  Kittel, 
1971,  for  a  discussion  of  crystal  structure.)11  We  then  make  the  following 
calculations.  For  each  photoreceptor  we  take  its  center  to  be  the  origin  and  use 
the  nearest  neighbor  distance  cut  determined  from  Fig.  6  to  locate  its  nearest 
neighbors.  We  then  measure  the  difference  between  expected  and  actual  positions 
for  the  photoreceptors  just  assigned  to  the  ring  of  nearest  neighbors  assuming  a 
perfect  hexagonal  lattice  with  the  basis  vectors  determined  above.  The  nearest 
neighbor  distance  cut  is  then  used  again  to  move  out  from  the  nearest  neighbors  to 
the  ring  of  second  nearest  neighbors  and  again  we  measure  the  error  in  actual 
position  versus  the  expected  position  for  a  perfect  hexagonal  lattice  centered  on 
the  original  photoreceptor.  We  continue  this  process  until  all  photoreceptors  have 
been  assigned  to  some  ring  and  their  errors  computed.  The  process  is  then  repeated 
with  a  new  photoreceptor  at  the  origin.  Fig  7  shows  a  graph  of  the  variance  (mean 
square  error)  in  relative  position  as  a  function  of  ring  number.  The  data  have 
been  normalized  so  that  the  mean  nearest  neighbor  photoreceptor  distance  (ring  1) 


FIG  7 


•»iv.vlv 


9 


Joy  Hirsch 
F49620-83-C-0026 


is  1.0.  Ve  plot  separately  the  components  of  variance  parallel  and  perpendicular 
to  the  line  which  joined  the  photoreceptor  at  the  origin  and  the  one  being  tested. 
The  parallel  component  corresponds  to  errors  in  separation  while  the  perpendicular 
component  corresponds  to  errors  in  orientation.  The  variance  increases  linearly 
with  distance  (ring  number),  consistent  with  accumulating  uncorrelated  errors,  and 
the  parameters  of  the  best  fit  straight  lines  are  given  in  Table  I.  Measurement 
error  and  jitter  in  the  lattice  (discussed  below)  would  lead  to  a  positive  y 
intercept  and  appear  to  be  small. 


Table  I 


If  we  define  the  positional  correlation  length  of  the  lattice  as  the  distance 
between  two  lattice  points  at  which  the  rms  spacing  error  equals  the  lattice 
spacing,  then  the  co^.-olation  length  for  the  parallel  component  is  178  +  7 
photoreceptors  and  for  the  perpendicular  component  the  correlation  length  is  133 
+  5  photoreceptors. 


Sources  of  error  and  limitations  of  the  analysis. 

While  these  results  establish  that  the  photoreceptor  lattice  is  highly 
accurate,  there  is  a  potential  problem  with  the  data  that  may  have  caused  the 
degree  of  error  to  be  severely  overestimated.  Close  inspection  of  the  lattice  in 
Fig.  5  leaves  the  impression  that  the  lines  formed  by  nearest  neighbor 
photoreceptors  are  not  perfectly  straight  but  rather  possess  a  slight  degree  of 
curvature.  Numerical  analysis  confirms  that  this  is  indeed  the  case  and  that  the 
lattice  is  systematically  distorted.  Further,  these  systematic  errors  contribute 
substantially  to  the  increase  in  variance  with  distance  shown  in  Fig.  7.  If  these 
distortions  were  introduced  in  the  preparation  process  they  should  be  removed  from 
the  data,  and  one  might  even  argue  that,  regardless  of  origin,  systematic  errors 
are  correctible  and  should  not  be  included  in  this  analysis. 

We  have  attempted  to  correct  for  this  problem  in  a  number  of  ways  and  conclude 
that  systematic  distortion  accounts  for  roughly  half  of  the  slope  in  Fig.  7  while 
decreasing  the  ring  1  variances  only  slightly.  (Jitter  in  the  lattice  is  then 
signif icant) .  We  estimate  that  with  the  systematic  distortions  removed,  the 
correlation  lengths  may  be  as  much  as  400  for  the  parallel  and  200  for  the 
perpendicular  components  respectively,  with  the  psychophysical  limit  intersecting 
the  parallel  variance  at  about  2.3  photoreceptors.  Thus  we  believe  the  above 
estimates  of  correlation  length  are  conservative. 


CONCLUSION 

We  have  quantitatively  analysed  the  spatial  quality  of  a  primate  foveal  cone 
lattice.  We  find  that  it  is  a  high  quality  hexagonal  lattice  with  a  correlation 
length  of  at  least  130  photoreceptors  over  spans  of  tens  of  photoreceptors.  We 
find  that  there  is  not  sufficient  disorder  in  the  foveal  lattice  to  prevent 
aliasing.  Rather  the  photoreceptor  lattice  seems  to  be  constructed  with  sufficient 
accuracy  so  that  it  can  serve  as  the  fundamental  metric  for  spatial  vision  even  in 
hyperacuity  tasks.  This  suggests  there  is  no  need  for  any  visual  mechanism  to 
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measure  the  true  photoreceptor  positions  and  the  burden  of  spatial  calibration 
falls  on  the  developmental  processes  involved  in  the  formation  of  the  photoreceptor 
lattice.  The  measurements  reported  here  combined  with  our  previous  psychophysical 
results  suggest  a  model  of  spatial  vision  in  which  the  photoreceptor  lattice  is  the 
sole  geometrical  element  with  all  other  elements  being  topological. 

3.  SPATIAL  FREQUENCY  DISCRIMINATION  AS  A  FUNCTION  OF  STIMPLPS  ORIENTATION. 


Recently  we  reported  that  discriminating  between  spatial  frequencies  of 
suprathreshold  sinusoidal  gratings  near  and  above  four  cycles/degree  (c/deg)  is  a 
task  involving  spatial  hyperacuity,  angular  resolutions  finer  than  the  center-to- 
center  spacing  of  foveal  photoreceptors^.  Further,  the  magnitudes  of  the 
hyperacuity  thresholds  were  related  to  the  center-to-center  spacing  of 
photoreceptors.  We  suggested  that  this  relationship  was  due  to  a  cortical 
representation  of  the  image  that  directly  reflected  the  organization  of  the  retinal 
photoreceptor  lattice.  A  logical  consequence  of  this  argument  is  that  the  two 
dimensional  properties  of  the  cortical  mechanisms  which  process  spatial  information 
should  also  reflect  the  two  dimensional  organization  of  the  photoreceptor  lattice. 
In  this  paper  we  report  evidence  that  this  is  indeed  the  case  and  that  the 
orientation  dependence  of  two  different  tasks  involving  hyperacuity  contains  a 
component  with  hexagonal  symmetry  (period  =  60s),  presumably  reflecting  the 
hexagonal  packing  of  photoreceptors.*®  In  addition,  we  find  that  the 
orientation  dependence  of  vernier  offset  discrimination  contains  another  component 
with  square  symmetry  (period  *  90°)  and  that  the  phases  of  the  components  of  the 
two  tasks  are  not  arbitrary.  We  present  a  specific  model  for  the  origin  of  the 
hexagonal  component. 


METHODS 

Two  different  tasks  were  employed:  discriminating  between  spatial  frequencies 
of  suprathreshold  sinusoidal  gratings  and  discriminating  the  direction  of  the 
vernier  offset  of  two  narrow  lines.  In  both  experiments  stimuli  were 
electronically  generated  on  an  oscilloscope  screen  (Tektronix  606).  A  single 
experimental  session  measured  a  threshold  for  a  particular  orientation,  so  that  the 
orientation  of  all  patterns  remained  constant  during  each  session.  Different 
orientations  were  set  for  different  sessions  by  physically  rotating  the  display, 
which  was  a  4  deg  circular  field  set  in  a  12  deg  circular  surround  matched  in  hue 
and  brightness  to  the  central  display  field.  The  orientation  for  each  session  was 
chosen  in  an  irregular  order  separately  for  each  observer  and  task.  Observers  in 
both  experiments  were  seated  130  cm  from  the  stimulus  screen.  Head  stabilization 
was  achieved  by  a  chin  and  forehead  rest  modified  to  also  include  bilateral  head 
supports. 

In  the  case  of  the  spatial  frequency  discrimination  experiments  sinusoidal 
gratings  were  displayed  at  30%  contrast.  Each  session  employed  a  constant 
reference  frequency  and  a  set  of  nine  test  frequencies  chosen  symmetrically  around 
the  reference.  Each  trial  consisted  of  a  .73  sec  presentation  of  the  reference 
grating,  a  .73  sec  interstimulus  interval,  and  a  .73  sec  presentation  of  one  of  the 
test  gratings.  Spatial  phase  was  randomized  on  each  presentation  for  both 
reference  and  test  gratings  independently.  The  order  of  test  presentations  was 
randomized  according  to  the  method  of  constant  stimuli  and  each  test  pattern  was 
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presented  50  times.  Following  each  trial  the  observer  indicated  whether  the  test 
frequency  was  higher  or  lower  than  the  reference  and  was  given  feedback  by 
synthesized  voice  indicating  the  true  relationship.  The  probability  distributions 
were  fit  to  a  cumulative  normal  uistribution  and  the  just  noticeable  difference 
(jnd)  in  frequency  (Af)  was  defined  as  the  change  in  frequency  necessary  to 
increase  the  probability  of  a  correct  response  from  .5  to  .75.  The  fitting 
procedure  also  estimated  the  statistical  error  in  Af.  Full  details  of  the  spatial 
frequency  discrimination  experiments  have  previously  been  reported. 

The  vernier  offset  experiments  were  identical  in  all  respects  to  the  spatial 
frequency  discrimination  experiments  except  that  each  presentation  of  a  grating  was 
replaced  by  the  presentation  of  a  vernier  discrimination  target  consisting  of  two 

narrow  line  segments  each  .25  deg  long  separated  by  a  gap  of  .25  deg.  For  the 

reference  pattern  the  two  lines  were  col inear  while  the  test  patterns  had  small 
perpendicular  offsets.  The  overall  position  of  the  target  was  randomly  offset  from 
the  center  of  the  screen  for  the  test  and  reference  patterns  independently  on  each 
trial  by  up  to  .2  deg.  The  task  of  the  observer  was  to  determine  the  direction  of 
the  vernier  offset,  and  the  jnd  in  offset  (Ao)  was  determined  as  for  Af. 

Orientation  for  different  sessions  was  again  varied  by  physically  rotating  the 
screen. 

Two  well-practiced  observers  participated  in  this  experiment.  Neither  wore 
any  optical  correction  during  the  experiment.  Visual  acuity  for  JH  was  20/20  in 

each  eye  with  no  astigmatism,  and  the  axial  length  for  her  right  eye  was  22.2  mm. 

Visual  acuity  for  SC  was  also  20/20  in  each  eye  with  no  astigmatism.  The  axial 
length  for  her  right  eye  was  22.1  aim.  Neither  observer  had  any  history  of  eye 
disease,  and  we  assume  both  observers  are  representative  of  normal  vision. 


RESULTS 

The  results  of  the  spatial  frequency  experiments  are  shown  in  Fig.  8  for 
observer  SC  at  a  reference  frequency  of  4.0  c/deg  and  for  observer  JH  at  a 
reference  frequency  of  4.5  c/deg.  As  discussed  below  these  reference  frequencies 


FIG  8 


were  chosen  in  the  expectation  (derived  from  our  model  of  spatial-frequency 
discrimination)  that  they  would  maximize  the  hexagonal  orientation  effects 
predicted  above.  The  figure  shows  the  fractional  jnd  in  spatial  frequency  Af/f  (f 
is  the  reference  frequency)  plotted  against  the  orientation  of  the  grating  where  an 
orientation  of  0*  corresponds  to  the  usual  vertical  grating.  The  data  are  clearly 
not  constant  but  show  significant  variation  with  orientation. **  Multiple  data 
points  are  repeated  measurements  over  time  and  show  good  stability. The 
curves  are  fits  to  the  data  and  are  discussed  in  detail  below. 

Fig.  9  shows  the  results  for  the  vernier  discrimination  experiments  for  the 


FIG  9 
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suae  two  observers  with  the  gap  in  the  vernier  target  equal  to  .25  deg,  also  chosen 
in  the  expectation  of  a  maximal  hexagonal  effect.  The  vernier  offset  thresholds 
are  plotted  against  the  orientation  of  the  stimulus  with  an  orientation  of  90° 
corresponding  to  the  usual  vertical  vernier  target.  This  choice  is  not  arbitrary 
but  is  required  to  align  the  vernier  discrimination  data  with  the  spatial  frequency 
discrimination  data.  The  vernier  thresholds  also  clearly  depend  on  orientation  and 
are  stable  over  time  as  indicated  by  multiple  determinations. 


DATA  ANALYSIS 

We  find  that  the  orientation  dependence  of  the  data  presented  above  consists  of 
the  sum  of  two  periodic  components,  one  with  hexagonal  symmetry  (60°  period)  and 
harmonics  thereof  and  the  other  with  square  symmetry  (90°  period)  and  its 
harmonics.  The  most  general  form  for  a  component  with  period  L  is 


N 

*n  cos  (2n  N  x/L)  +  bN  sin  (2n  N  x/L) .  (1) 

N=1 


However,  we  also  require  that  there  be  no  difference  between  positive  and  negative 
rotation  leading  to  the  more  restricted  form: 


M 

*<*>  *N  cos  (2n  N  (x-xo)/L)  (2) 

N=1 


which  has  even  symmetry  around  some  unknown  symmetry  axis  xq.  The  value  of  N 
(the  number  of  harmonics)  is  in  principle  determined  by  sampling  requirements  but 
in  practice  N  ■  2  suffices  for  all  the  data  reported  here  except  for  the  JH  vernier 
discrimination  data  which  requires  some  higher  harmonics  of  the  square  component  to 
achieve  a  good  fit. 

Table  II  shows  the  results  of  fitting  the  data  in  Fig  8  and  Fig  9  to  four 


Table  II 


different  models  of  orientation  dependence:  (1)  no  orientation  dependence,  (2)  the 
orientation  dependence  consists  of  a  hexagonal  component  only,  (3)  a  square 
component  only,  and  (4)  the  sum  of  a  square  and  hexagonal  component.  The  chi 
squared  (Xs)  values,  degrees  of  freedom  (df)  and  levels  of  confidence  for  the  fits 
are  listed  in  the  table.  A  large  chi  squared  indicates  that  the  deviations  of  the 
data  from  the  model  are  larger  than  can  be  accounted  for  by  the  error  bars.  Both 
frequency  discrimination  observers  have  marginally  acceptable  fits  for  the 
hexagonal  only  model  and  good  fits  for  the  hexagonal  +  sqnare  model  while  the 
square  only  model  is  rejected.  The  hexagonal  +  square  model  gives  a  good  fit  for 
both  vernier  discrimination  observers  while  all  other  models  are  rejected.  The  fit 
to  the  hexagonal  +  square  model  is  shown  in  Fig  8  and  Fig  9  (dark  lines  through  the 
data) . 
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The  decoaposition  of  the  total  orientation  dependence  into  hexagonal  and 
square  coaponents  is  shown  in  Fig  10.  The  middle  plot  in  each  of  the  four  parts 


FIG  10 


shows  the  fit  to  the  hexagonal  +  square  model  along  with  the  data  from  Fig  8  and 
Fig  9  with  the  aean  value  subtracted.  Immediately  above  and  below  each  fit  is 
separately  plotted  the  hexagonal  and  square  component  respectively.  There  are  a 
number  of  noteworthy  features.  First,  the  phases  of  the  hexagonal  components  are 
fairly  closely  aligned  across  tasks  and  across  observers,  having  a  minimum  near 
90*.  Vhile  this  orientation  represents  a  vertical  vernier  target,  the 
corresponding  grating  is  horizontal.  This  is  an  important  observation  since  it 
demonstrates  that  the  orientation  on  which  the  hexagonal  component  primarily 
depends  is  not  the  orientation  along  which  the  jnd  is  being  measured  (the  jnd's  are 
measured  along  orthogonal  directions  for  vertical  vernier  targets  and  horizontal 
gratings)  but  some  other  direction,  and  a  possible  explanation  is  given  below.  The 
square  component  for  the  vernier  data  also  has  a  minimum  near  90*  (and  0*).  The 
square  components  for  the  spatial  frequency  data  (which  are  only  marginally 
statistically  significant)  seep  to  be  more  octagonal  (period  ■  45*)  than  square. 

The  results  above  show  that  a  model  consisting  of  the  sum  of  a  hexagonal  plus 
a  square  component,  each  with  even  symmetry,  is  sufficient  to  explain  the  observed 
orientation  functions  reported  here,  and  both  components  are  necessary  within  this 
model.  The  necessity  of  the  hexagonal  and  square  components  can  also  be 
established  in  a  very  strong  model  independent  manner,  leading  to  the  conclusion 
that  it  is  essentially  impossible  for  any  model  which  lacks  either  component  to  fit 
the  data. 


DISCUSSION 

These  results  demonstrate  that  the  hyperacuity  thresholds  reported  here 
display  an  orientation  anisotropy  having  components  with  both  hexagonal  and  square 
symmetry.  This  effeot  cannot  be  an  artifact  since  our  display  apparatus  was 
circularly  symmetric.  Although  a  square  component  or  'oblique  effect'  is  most 
often  reported  in  spatial  tasks  as  a  function  of  orientation1®-1*,  Caelli 
et  al.  have  recently  reported  spatial  frequency  discrimination  data  that  also 
clearly  show  a  strong  (0*  periodicity  for  one  observer  and  what  appears  to  be  a 
mixture  of  60*  and  90*  components  for  other  observers. Since  in  our  study, 
two  quite  different  tasks,  spatial  frequency  discrimination  and  vernier  offset 
discrimination,  both  show  a  hexagonal  component  we  conclude  the  underlying  cause 
must  be  general.  Extending  arguments  made  previously,  we  attribute  the  hexagonal 
orientstion  anisotropy  of  hyperacuity  to  the  existence  of  s  cortical  representation 
of  an  image,  which  we  refer  to  as  s  neural  lattice,  that  preserves  the  hexagonal 
symmetry  of  the  retinal  photoreceptor  lattice.  Ve  present  below  a  specific  model 
to  explain  the  manifestation  of  the  hexagonal  symmetry  in  tasks  involving  the 
measurement  of  spatial  separations.  This  model  does  not  account  for  all 
orientation  effects  in  spatial  vision  and  in  particular  the  origin  of  the  square 
component  is  not  addressed. 
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The  basic  proposal  ve  sake  for  the  hexagonal  component  is  quite  simple:  the 
human  visual  system  does  not  measure  separations  or  distances  in  arbitrary 
directions.  Rather  there  exist  a  set  of  intrinsic  directions  fixed  by  the 
orientation  of  the  observer's  head  and  the  hexagonal  structure  of  the  photoreceptor 
lattice,  and  distance  is  assumed  to  be  measured  parallel  to  one  of  these 
directions.  As  a  consequence  the  'effective'  distance  between  two  parallel  lines 
is  not  necessarily  the  perpendicular  distance  but  rather  the  distance  measured 
along  one  of  the  intrinsic  directions,  presumably  the  one  closest  to  the 
perpendicular.  The  usual  identification  of  the  perpendicular  distance  as  the 
'true'  or  objective  distance  rests  on  the  unstated  assumption  that  the  visual 
system  possesses  rulers  at  every  possible  orientation.  However  the  hexagonal 
symmetry  reported  here  suggests  that  there  are  only  three  such  intrinsic 
measurement  directions,  separated  by  €0*,  presumably  due  to  a  cortical  reflection 
of  the  hexagonal  photoreceptor  packing. 

More  specifically,  we  have  previously  argued  that  the  human  visual  system 
measures  distances  (and  spatial  frequencies)  by  identifying  features  on  a  neural 
lattice  (for  instance,  two  successive  peaks  in  the  case  of  a  sinewave  grating  or 
perhaps  points  of  inflection^* ,  the  exact  feature  being  irrelevant  here)  and 
then  counting  the  number  of  lattice  points  separating  them.  Ve  make  here  the 
additional  suggestion  that  this  counting  can  only  be  done  along  the  basis 
directions  of  the  lattice,  the  directions  for  which  the  lattice  is  most  closely 
spaced.  The  net  result  is  an  enormous  reduction  in  the  complexity  of  the  distance 
measuring  mechanism  since  it  need  not  deal  with  arbitrary  directions,  but  at  the 
price  of  potentially  introducing  orientation-dependent  errors  in  distance 
measurements.  If  the  perpendicular  distance  between  two  lines  is  sp,  the 
'effective'  distance  measured  along  one  of  the  intrinsic  lattice  directions  is 
•p/cos(A)  where  A  is  the  angle  between  the  perpendicular  and  the  nearest  lattice 
direction.  Since  the  intrinsic  lattice  directions  are  separated  by  60°,  A  cannot 
exceed  30*  and  the  maximum  effect  is  an  effective  distance  se  =  sp/cos(30°)  * 

1.15  S-,  a  +  7.5%  effect.  The  typical  error  introduced  by  this  mechanism  is 

given  by  the  standard  deviation  of  cos(A)  between  +  30*  which  is  4%.  The 
smallness  of  the  effect  is  due  to  the  flatness  of  the  cosine  function  over  a 
considerable  region  around  zero.  Since  spatial  frequencies  are  proportional  to  1/s 
the  effective  spatial  frequency  fv  will  be  fe  »  fp  cos(A)  where  fp  is  the 
frequency  measured  perpendicular  to  the  wavefronts.  Note  that  effective  distances 
are  always  larger  and  the  effective  spatial  frequencies  are  always  lower  than  the 
corresponding  perpendicular  measurements.  (The  above  arguments  assume 
perpendicular  projections  onto  the  lattice  directions.  The  projections  might 
instead  involve  some  sort  of  dogleg  along  the  lattice  directions,  modifying  the 
above  formulae  somewhat.  The  magnitude  of  the  effect  is  unchanged  and  effective 
distances  are  again  always  larger,  but  the  exact  relationship  becomes 

•«  ■  sp*  cos(30*-A)/cos(30*) .) 


FIG  11 
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Since  the  expected  hexagonal  orientation  effects  derived  above  are  fairly 
snail,  it  follows  that  they  would  be  difficult  to  observe  directly.  However,  we 
have  previously  shown  that  at  certain  transition  frequencies  spatial  frequency 
discrinination  is  a  very  rapidly  changing  function  of  frequency,  and  this  can  be 
used  to  amplify  the  effect.  Fig  11  shows  Afp/fp  at  a  function  of  the  reference 
frequency  fp  for  gratings  at  0*  orientation  (vertical)  for  observer  SC.  Ve  have 
previously  shown  that  this  function  consists  of  segments  which  are  straight  lines 
passing  through  the  origin  (drawn  in  the  figure)  separated  by  transition  regions 
(the  first  at  -  4  c/deg)  where  Afp/fp  falls  rapidly  with  frequency.  Given 
the  arguments  above,  we  should  have  plotted  Afe/fe  as  a  function  of  fe  where 
f«  is  the  effective  frequency  as  measured  by  the  observer.  Since  Afe/fe  - 
Afp/fp  the  y  axis  is  unchanged  but  all  values  on  the  x  axis  should  actually  be 
replaced  by  fp  cos(A-Aa)  where  A  is  0*  for  all  points  on  the  graph  and  At 
is  the  closest  intrinsic  measurement  direction.  For  simplicity  assume  A,  is  0* 
and  the  x  axis  is  actually  fe.  Suppose  we  tested  observer  SC  at  a  nominal 
frequency  of  4.0  c/deg  and  an  orientation  of  0*.  Then  we  should  get  the  value  of 
Af/f  shown  in  Fig  11  (~  .016).  Now  suppose  we  changed  the  grating  orientation  by 
30*  while  keeping  the  perpendicular  frequency  fixed.  This  reduces  the  effective 
frequency  to  4.0  *  cos(30*)  ■  3.5  cycles/deg  and  we  should  now  measure  Af/f  ~ 

.028.  In  effect  changing  the  orientation  by  30*  causes  the  effective  frequency  to 
walk  along  the  x  axis  in  Fig  4  from  4.0  to  3.5  cycles  per  degree,  and  Af/f  should 
vary  by  the  corresponding  amount  on  the  y  axis.  Increasing  A  to  60*  causes  fe  to 
walk  back  to  4.0  cycles/deg.  Inspecting  Fig  la  and  allowing  for  the  fact  that 
Aa  was  not  actually  0*  indicates  that  this  is  nearly  the  case,  with  the 
orientation  data  oscillating  roughly  between  the  limits  expected  from  Fig  11.  The 
orientation  data  was  somewhat  lower  than  expected,  perhaps  partially  due  to  some 
contribution  from  the  square  component  or  to  a  small  practice  effect.  Note  also 
that  the  nonlinearity  in  the  frequency  discrimination  function  near  the  transition 
will  lead  to  a  potentially  complicated  shape  for  the  hexagonal  component  even 
though  the  effective  frequency  is  a  fairly  simple  function  of  orientation. 

Actually  the  fitted  hexagonal  components  (Fig  3)  have  relatively  narrow  dips  and 
fairly  flat  maxima,  possibly  indicating  that  the  effective  frequency  walked  to  the 
top  of  the  transition  in  Fig  4  and  then  started  moving  down  the  first  segment.  The 
results  for  JH  are  similar  with  the  transition  occuring  at  a  somewhat  higher 
frequency.  Notice  that  we  have  exploited  the  transition  region  in  Fig  11,  where 
Af/f  is  a  rapidly  changing  function  of  f,  in  order  to  magnify  the  expected  small 
effects  of  orientation  and  produce  the  striking  results  of  Fig  1.  At  higher 
frequencies  the  transitions  are  smaller  and  we  expect  the  hexagonal  component  to  be 
much  smaller.  The  exact  shape  of  the  hexagonal  component  for  the  two  tasks  is 
almost  identical  for  observer  SC  bnt  not  for  JH.  However  we  do  not  feel  that  there 
is  any  reason  to  expect  that  the  shape  should  be  exactly  the  same  for  the  two  tasks 
since  we  expect  that  it  depends  quite  critically  on  aligning  the  transitions  for 
the  two  tasks  (shown  in  Fig  11  for  frequency  discrimination  and  discussed  below  for 
vernier  discrimination).  Indeed  we  expect  the  shape  of  the  component  to  vary  quite 
strongly  for  both  tasks  as  the  spatial  frequency  or  gap  size  is  varied  due  to  the 
severe  nonlinearity  of  the  frequency  discrimination  function  near  the  transition 
regions. 

Arguments  identical  to  the  ones  above  can  be  used  to  explain  the  hexagonal 
component  in  the  variation  of  vernier  discrimination  as  a  function  of  line  segment 
orientation.  Vernier  offset  thresholds  have  been  shown  to  be  a  function  of  the 
length  of  the  gap  between  the  two  lines.  The  effective  length  of  this  gap 
will  vary  with  orientation  similarly  to  the  effective  period  of  the  grating,  and  if 
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the  vernier  threshold  vs  gap  size  function  shows  trsnsitions  comparable  to  those  in 
spatial  frequency  discrimination  the  expected  small  hexagonal  component  will  be 
magnified.  Further,  this  explains  why  the  hexagonal  component  has  a  minimum 
for  vertical  vernier  targets  and  horizontal  spatial  frequency  gratings.  As  can  be 
seen  in  Fig  10  the  hexagonal  components  of  the  two  tasks  are  in  phase  when  the  gap 
of  the  vernier  stimulus  is  perpendicular  to  the  bars  of  the  grating  and  thus 
aligned  with  the  direction  between  bars  along  which  spatial  frequency  is  measured. 
This  is  consistent  with  our  expectation  that  the  variable  which  primarily 
determines  the  hyperacuity  threshold  (the  scale  setting  variable)  is  the  gap  for  a 
vernier  target  and  the  distance  between  bars  for  a  grating.  Note  also  that  the  two 
observers  are  nearly  in  phase  with  respect  to  the  hexagonal  component.  If,  as  we 
propose,  the  hexagonal  component  is  fundamentally  attributable  to  the  photoreceptor 
lattice,  this  suggests  that  the  photoreceptor  lattice  has  a  fixed  orientation  and 
very  likely  has  the  same  orientation  in  both  eyes. 


The  Square  Component 

The  square  component  observed  in  the  vernier  discrimination  data  is  presumably 
related  to  the  cosmonly  reported  'oblique  effect'.  Although  the  origin  of  the 
square  component  is  not  discussed  in  this  paper  we  assume  it  is  distinct  from  the 
hexagonal  component  with  which  we  are  primarily  concerned  here.  It  should  be  noted 
that  the  square  component  shows  far  less  task  to  task  consistency  in  our  data  than 
the  hexagonal  component,  possibly  indicating  a  less  fundamental  origin. 

CONCLUSION 

Guided  by  an  extension  of  our  previously  reported  model  of  spatial-frequency 
discrimination,  we  have  shown  that  hyperacuity  thresholds  as  a  function  of  stimulus 
orientation  contain  a  component  with  hexagonal  symmetry.  We  assume  that  this 
hexagonal  symmetry  is  fundamentally  related  to  the  hexagonal  packing  of 
photoreceptors.  Since  the  magnitudes  of  similar  hyperacuity  thresholds  have 
previously  been  related  to  the  center-to-center  spacing  of  photoreceptors^,  we 
conclude  that  there  is  now  strong  evidence  for  the  role  of  the  photoreceptor 
lattice  in  spatial  vision.  In  addition,  at  least  some  spatial  tasks  have  a 
component  with  square  symmetry  in  their  orientation  dependence.  We  propose  a  model 
of  spatial  vision  in  which  the  photoreceptor  lattice  provides  the  only  geometrical 
element,  with  all  other  elements  being  topological. 

OR  LOW  SPATIAL  FREQUENCIES. 


In  a  recent  paper  we  reported  that  the  ability  of  human  observers  to 
discriminate  between  different  spatial  frequencies  was  not  a  smooth  function  of 
frequency  but  rather  had  a  definite  segmented  structure. 9  We  interpreted  this 
structure  as  being  due  to  reconstruction  of  the  images  on  a  set  of  cortical 
lattices  with  discrete  effective  spacings  of  e/N  where  a  was  found  to  be  the  foveal 
photoreceptor  spacing  (~  0.008  deg)  and  N  was  an  integer  factor  attributable  to 
cortical  interpolation.  However  these  previous  results  were  restricted  to  spatial 
frequencies  above  2  cycles/degree  (c/deg)  and  our  model  did  not  deal  with  lower 
frequencies.  In  this  study  we  extend  our  measurements  to  frequencies  as  low  as  0.3 
c/deg  and  the  model  to  all  visually  accessible  spatial  frequencies.  For  spatial 
frequencies  between  0.3  and  2  c/deg  we  find  a  very  similar  s/N  segment  structure 
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with  e  equal  to  about  0.056  deg  or  7  tinea  the  foveal  photoreceptor  spacing.  Ve 
attribute  this  to  spatial  sampling  by  an  array  of  retinal  receptive  fields  which  we 
call  spatial  sampling  fields  and  which  also  perform  a  neural  blurring  analogous  to 
the  blurring  of  high  frequencies  by  the  optics  of  the  eye. 


METHODS 

The  methods  used  are  identical  to  those  previously  described  except  that  the 
gratings  consisted  of  narrow  bright  lines  on  a  dark  background  rather  than 
suprathreshold  sinusoidal  gratings.  Briefly,  each  experimental  session  employed  a 
fixed  reference  frequency  and  either  7  or  9  test  frequencies  chosen  symmetrically 
around  the  reference  frequency.  Each  trial  consisted  of  the  presentations  of  a 
reference  grating  for  0.75  sec,  an  interstimulus  interval  of  0.75  sec,  and  a  test 
grating  for  0.75  sec.  The  observer  responded  by  indicating  whether  the  test 
grating  had  a  higher  or  lower  spatial  frequency  than  the  reference.  Following  each 
response  a  synthesized  voice  indicated  the  correct  choice.  The  test  and  reference 
phases  were  independently  randomized  on  each  trial  and  test  frequencies  were 
randomized  together  according  to  the  method  of  constant  stimuli.  There  were 
usually  50  trials  per  test  stimulus  and  at  least  40.  Distance  from  the  observer  to 
the  display,  a  Tektronix  606  monitor,  was  varied  so  that  there  were  always  at  least 
3  lines  on  the  screen.  Head  stabilization  was  achieved  by  adjustable  chin  and 
forehead  rests  with  snug  cushions  on  both  sides  of  the  head.  Viewing  was  central 
but  with  no  explicit  fixation  target.  The  data  from  each  session  were  fit  to  a 
cumulative  normal  distribution  to  determine  the  just  noticeable  difference  (jnd)  in 
frequency  Af,  defined  as  the  change  in  frequency  necessary  to  raise  the  probability 
of  a  correct  response  from  0.5  to  0.75.  The  fitting  procedure  also  provided  an 
estimate  of  the  statistical  error  in  Af  for  each  session.  Following  our  previous 
work,  we  consider  the  separation  between  bars  s  *  1/f  as  the  critical  stimulus,  not 
f.  However  in  what  follows  we  will  generally  use  f  and  s  interchangeably. 

Further,  we  have  shown  that  As/s  *  Af/f,  and  note  that  the  inverse  of  separation  is 
dimensionally  the  same  as  spatial  frequency. 


RESULTS 

Fig.  12  shows  the  results  of  this  experiment  for  four  observers:  GC,  CS,  SC 


FIG  12 


and  SG.  The  fractional  jnd  in  spatial  separation  As/s  is  plotted  against  the 
inverse  of  spatial  separation  s  where  s  ■  1/f  is  the  distance  between  lines  in  the 
grating.  The  data  are  clearly  not  smooth  functions  of  frequency  but  cluster  around 
straight  lines  drawn  through  the  origin,  with  transitions  between  the  line  segments 
occurring  regularly  at  about  every  0.6  ~  0.7  c/deg.  This  segmented  structure 
has  been  seen  previously  at  higher  spatial  frequencies  (above  2  c/deg)  where  the 
spacing  between  transitions  was  about  4  c/deg. 
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Fig.  13  shows  the  high  frequency  Af/f  function  for  a  fifth  observer.  JH. 


FIG  13 


(The  data  on  this  figure  below  Id  c/deg  have  previously  been  published).  Note 
that  the  segaentation  and  the  average  value  of  Af/f  are  quite  siailar  to  that  in 
Fig.  12.  For  these  high  frequencies  it  was  found  that  the  slopes  of  the  line 
segaents  took  on  the  values  s/N  where  e  was  about  0.008  deg  (the  center  to  center 
spacing  of  foveal  photoreceptors)  and  N  was  an  integer. 

Ve  have  fit  the  data  in  Fig.  12  to  a  siailar  s/N  fora.  Excluding  the  few 
points  which  clearly  fall  in  transition  regions  and  a  few  aberrant  points  which  are 
not  consistent  with  their  neighbors  gives  acceptable  fits  to  this  aodel  (chi 
squared  confidence  level  >10%).  As  was  also  found  in  the  previous  high  frequency 
experiaents.  the  transition  frequencies  at  which  the  function  juaps  froa  one  line 
segaent  to  the  next  are  not  quite  evenly  spaced  for  reasons  that  are  not 
understood.  Nevertheless  the  overall  agreeaent  between  the  data  and  aodel  is 
fairly  good.  The  best  fit  values  of  s  for  the  four  observers  are:  0.054  +  0.001 
(CS).  0.055  +  0.001  (SC).  0.059  +  0.001  (SG)  and  0.030  +  0.0005  deg  (SG) . 

There  is  good  agreeaent  for  all  but  the  last  observer.  SG.  However,  this  atypical 
observer  also  has  the  lowest  value  of  •  for  the  high-frequency  band  (>  2  c/deg) 
that  we  have  encountered  so  far  (i  ■  0.0056  deg  where  0.008  is  typical)  and  is  not 
included  in  the  average. 


DISCUSSION 

The  discussion  here  closely  parallels  the  earlier  discussion  of  the  high 
frequency  results.  As  shown  in  our  previous  work  a  straight  line  passing 
through  the  origin  in  the  Af/f  vs  f  plane  is  a  region  in  which  the  jnd  in  spatial 
interval  As  is  constant.  Thus  the  segaents  of  slope  s/N  are  regions  in  which  there 
is  a  constant  spatial  jnd  As  ■  s/N.  Following  our  previous  work  we  attribute  each 
segaent  to  the  existence  of  a  cortical  lattice  with  effective  spacing  s/N.  For  N  ■ 
1  the  cortical  lattice  has  the  saae  effective  spaoing  as  the  retinal  spatial 
saapling  lattice  while  the  higher  N  lattices  are  constructed  by  interpolating 
between  the  retinal  saaples  onto  a  cortical  lattice  with  a  spacing  N  tiaes  finer 
than  the  spacing  of  the  retinal  lattice.  This  scheae  represents  a  highly  efficient 
use  of  the  retina  to  cortex  connections.  For  the  high  frequency  band  (above  2 
c/deg)  the  fundaaental  spacing  t  was  found  to  be  about  0.008  deg  or  one 
photoreceptor*  and  as  seen  froa  Fig.  13.  N  aay  be  as  high  as  8  (taking  -32  c/deg  as 
the  high  frequency  liait),  although  it  would  be  very  difficult  to  prove  that 
all  the  iateraediate  values  of  N  exist.  For  the  frequency  band  froa  0.3  to  2  c/deg 
(which  we  call  the  aid-frequency  band),  s  is  about  0.056  deg  or  7  tiaes  the  spacing 
of  the  photoreceptor  and  N  goes  froa  1  to  4.  Ve  attribute  this  value  of  s  to  the 
existence  of  a  class  of  retinal  receptive  fields,  the  aid-frequency  spatial 
saapling  fields,  which  have  a  center  to  center  spacing  of  0.056  deg.  These  fields 
have  two  functions.  First,  they  perfora  a  spatial  saapling  function  analogous  to 
that  of  the  photoreceptor,  reducing  a  continuous  luainance  distribution  to  a  finite 
nuaber  of  aeasureaents  per  unit  interval  for  transaission  to  the  cortex,  but  on  a 
larger  scale  and  thus  drastically  reducing  the  nuaber  of  fibers  required  in  the 
optic  nerve.  However,  cortical  interpolation  between  saaples  is  iapossible  unless 
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the  iaage  is  saffieiently  blurred  to  excite  st  least  three  sasiple  points  (in  one 
diaension) .1*2,3  por  tj,»  high  spatial  frequencies  this  blurring  is  performed  by 
the  optics  of  the  eye.  *  For  the  aid-frequency  band  the  blurring  aust  be 
accoaplished  neural ly  by  overlapping  the  spatial  saapling  fields  to  a  considerable 
extent.  Thus  the  widths  of  the  fields  aust  be  several  times  their  center-to-center 
separation  or  about  0.1  ~  0.2  deg  full  width  at  half  maximum  for  the  excitatory 
center.  3  This  is  in  reasonable  agreement  with  previous  psychophysical 
estiaates  of  receptor  field  sixes.  For  exaaple,  Wilson  and  Gelb  propose  a  model 
having  a  discrete  set  of  6  receptive  field  sizes  of  which  one  has  a  center  spacing 
of  0.05S  deg  (with  a  0.23  octave  observer  to  observer  variation)  and  another  has  a 
center  spacing  of  0.047  deg,  both  quite  comparable  to  the  values  reported 
here.  ®  The  receptive  field  widths  estiaated  by  Wilson  and  Gelb  are  also 
coaparable  to  our  soaewhat  poorly  constrained  estiaates. 


Scalina 

One  of  the  remarkable  features  of  Figures  1  and  2  is  that  the  average  value  of 
Af/f  or  As/s  is  fairly  constant  over  a  rather  large  range  of  frequencies.  We 
attribute  this  to  a  scaling  property  of  the  visual  system  in  which  the  cortical 
lattice  on  which  an  iaage  ia  analyzed  is  always  chosen  such  that  e(s)/s  is  roughly 
constant  where  s(s)  is  the  lattice  spacing  and  s  is  the  characteristic  size  or 
spatial  scale  of  the  feature  being  analyzed.  (For  a  grating  s  is  the  distance 
between  bars.)  Since  s(s)  will  clearly  be  related  to  the  spatial  resolution,  the 
net  effect  is  that  resolution  scales  with  iaage  size  so  that  the  fractional 
resolution  appears  roughly  constant. 


Consider  how  aany  cortical  aaps  are  required  for  such  a  scaling  systea.  Froa 
Fig.  13  it  is  clear  that  8  aaps  suffice  to  cover  spatial  scales  froa  1/32  to  1/2 
deg,  which  we  label  the  high  frequency  band.  Froa  Fig.  12  we  can  see  that  4  aaps 
are  sufficient  to  cover  spatial  scales  froa  1/2  to  3.5  deg,  the  aid  frequency 
band.  We  will  assume  that  Fig.  13  repeats  two  aore  tiaes  for  still  lower 
frequencies  with  the  spatial  scale  increasing  each  tine  by  a  factor  of  7.  That  is, 
we  assuae  that  there  exist  two  aore  classes  of  retinal  sampling  fields,  one  with 
center-to-center  separation  of  0.4  deg  and  one  with  center-to-center  spacing  of  2.8 
deg.  The  foraer  would  aediate  the  low  frequency  band  (spatial  scale  3.3  deg  to  25 
deg)  and  the  latter  the  very  low  frequency  band  (25  deg  to  175  deg).  Each  of 
these  bands  is  assuaed  to  be  subdivided  into  4  segments  by  the  cortical 
interpolation  aechanisas.  Thus  a  total  of  20  cortical  lattices  would  suffice  to 
cover  all  scales  accessible  to  the  huasn  visual  systea,  a  5600:1  range,  while 
keeping  As/a  conatant  to  within  2:1  in  the  worst  case  (the  N”1  to  N«2  transition). 
The  typical  deviation  is  auch  saaller  with  the  ras  deviation  being  about  16%  of  the 
aean.  The  well  established  rise  in  resolution  with  eccentricity^ 
presumably  occurs  becanse  progressively  finer  aaps  are  restricted  to  progressively 
saaller  eccentricities. 


Note  that  the  notion  of  scaling  presented  here  differs  quite  fundamentally 
froa  the  usual  concept  of  cortical  aagnif ication.3*“34  The  conventional  nodel 
as suae s  the  existence  of  a  single  nonlinear  napping  between  retina  and  cortex, 
which  can  be  pictured  as  a  set  of  narrow  concentric  annuli  of  increasing  inverse 
cortical  aagnif ication  reaulting  in  a  continuous  local  scaling  with  eccentricity. 
This  is  not  consistent  with  the  finding  presented  here  that  coarse  spatial 
quantisation  also  exists  in  the  central  retina,  although  one  could  add  coarser  aaps 


20 


Joy  Hirsch 
F49620-83-C-0026 


with  similar  continuous  nonlinear  scaling  properties.  Ve  propose  instead  (or 
perhaps  in  addition)  the  existence  of  a  set  of  about  20  linear  naps  with  autoaatic 
scale  selection  to  achieve  an  apparent  scale  independence.  This  can  be  pictured  as 
a  set  of  overlapping  concentric  disks  of  differing  but  constant  cortical 
■agnif ication,  with  the  coarser  naps  extending  to  greater  eccentricities.  If  we 
assume  the  total  extent  of  a  nap  to  be  proportional  to  the  lattice  spacing  (i.e., 
the  number  of  points  in  each  nap  constant),  the  apparent  inverse  cortical 
magnification  factor  will  be  roughly  proportional  to  eccentricity,  where  the 
apparent  magnification  is  presumed  to  be  due  to  the  finest  map  at  the  given 
eccentricity.  The  scaling  in  this  model  is  primarily  with  feature  sixe,  with  the 
eccentricity  scaling  being  somewhat  incidental,  and  also  not  continuous. 

Linear  maps  offer  great  advantages  over  nonlinear  maps.  In  particular,  it  is 
generally  quite  difficult  to  measure  distance  on  a  nonlinear  map,  since  this 
requires  integrating  variable  magnification  factors  over  some  hard  to  specify 
path.  Further,  an  image  which  extends  over  a  region  in  which  the  nonlinear 
magnification  factor  varies  significantly  will  generally  be  subject  to  large 
position-dependent  distortions,  greatly  complicating  pattern  recognition,  although 
some  non-linear  mappings  may  have  useful  properties. 3'  The  mechanism  we  propose 
avoids  these  problems  while  still  achieving  apparent  scale  invariance. 


CONCLUSION 

Ve  have  shown  that  spatial  frequency  discrimination  as  a  function  of  frequency 
in  not  a  smooth  function  of  frequency  for  frequencies  between  0.3  and  2  c/deg  but 
rather  has  a  segmented  structure  similar  to  that  observed  for  spatial  frequencies 
above  2  c/deg.  Ve  interpret  this  as  evidence  for  spatial  quantixation  by  retinal 
spatial  sampling  fields  having  a  center-to-center  spacing  of  about  0.036  deg.  Ve 
suggest  that  there  may  also  exist  spatial  sampling  fields  with  center-to-center 
spacing  of  0.4  deg  and  2.8  deg.  Ve  propose  a  scaled  lattice  model  of  spatial 
vision  which  allows  apparently  scale  independent  spatial  processing  while  retaining 
the  benefits  of  linear  maps. 


5.  A  MODEL  OF  SPATIAL  DISCRIMINATION 

THE  SCALED  LATTICE  MODEL  OF  SPATIAL  VISION 

Ve  present  here  an  outline  of  the  scaled  lattice  model  of  spatial  vision.  The 
reader  must  be  cautioned  that  the  development  of  the  model  is  in  an  early  stage  and 
there  are  major  aspects  which  need  to  be  further  addressed  experimentally. 

Notably,  we  neglect  binocular  vision,  two  dimensional  considerations,  temporal 
effects,  and  the  interaction  between  multiple  simultaneously  present  spatial 
scales.  However  the  following  provides  a  listing  of  some  important  elements  and  a 
basis  for  future  development. 

1.  Retinal  images  are  optically  blurred  and  sampled  by  photoreceptors.  In 
the  central  region  of  the  retina  the  output  of  each  photoreceptor  (perhaps  after 
convolution  with  some  local  weighting  function  designed  to  remove  low  frequencies) 
is  then  transmitted  to  the  cortex  for  further  processing.  Over  the  central  and 
larger  regions  photoreceptors  are  pooled  into  regularly  spaced  spatial  sampling 
fields  with  overlapping  excitation  functions  designed  to  remove  high  frequencies 
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and  provide  sufficient  neural  blurring  to  allow  interpolation  between  field 
centers.  Only  one  output  per  spatial  sampling  field  is  transmitted  to  the  cortex. 
There  are  presumably  a  sequence  of  classes  of  spatial  sampling  fields  of  increasing 
center-to-center  spacing  with  the  spatial  extent  covered  by  each  class  presumed 
proportional  to  the  spacing  of  that  class.  That  is,  the  optic  nerve  per  each 
photoreceptor  sampling  and  all  the  classes  of  receptive  field  sampling  coexist  in 
the  central  part  of  the  retina  but  the  coarser  samplings  extend  to  greater 
eccentricitiea.  The  point  of  this  scheme  is  to  efficiently  encode  the  position 
information  in  the  retinal  image  by  sampling  near  the  sampling  limit  for  multiple 
spatial  scales  and  thus  minimize  the  number  of  cortical  connections.  The  multiple 
scales  of  sampling  allow  more  detail  to  be  encoded  at  smaller  eccentricities. 

2.  The  image  is  reconstructed  in  the  cortex  for  a  given  sampling  scale  by 
interpolating  between  sample  points  onto  a  neural  lattice  whose  spacing  is  an 
integer  (N)  times  finer  than  the  sample  spacing.  Note  that  there  is  no  information 
in  this  reconstruction  that  was  not  present  in  the  original  sampling.  The  neural 
lattices  (with  N  >  1)  basically  represent  an  unpacking  of  the  highly  encoded 
information  in  the  original  sampling  into  a  form  in  which  the  position  information 
is  more  accessible*  with  higher  values  of  N  allowing  more  detailed  unpacking  and 
hence  more  accurate  localization  of  the  features  of  the  image.  The  interpolation 
may  include  convolution  with  a  function  designed  to  enhance  some  aspect  of  the 
image  or  to  remove  frequencies  too  low  to  be  of  interest.  The  total  spatial  extent 
of  each  lattice  is  assumed  proportional  to  the  effective  lattice  spacing,  resulting 
in  an  apparent  inverse  cortical  magnification  factor  that  is  a  roughly  linear 
function  of  eccentricity. 

3.  The  positions  of  local  features  such  as  peaks  or  perhaps  points  of 
inflection^*  are  determined  to  the  nearest  lattice  point  by  comparing 
neighboring  points  in  the  neural  lattice.  For  example,  peaks  can  be  localized  by 
testing  three  successive  points  to  sew  if  the  sign  of  the  slope  has  changed. 

4.  Spatial  intervals  are  measured  by  counting  points  in  the  neural  lattice 
between  the  features  located  above.  Assuming  the  localization  procedure  is 
sufficiently  accurate,  the  error  (jnd)  in  the  spatial  interval  will  then  be 
dominated  by  the  effective  spacing  of  the  neural  grid.  Thus  the  neural  lattices, 
which  are  derived  from  the  photoreceptor  lattice,  serve  as  rulers  of  differing 
scales  for  the  measurement  of  spatial  intervals. ^ 

5.  There  exists  an  automatic  scale  selection  mechanism  which  chooses  the 
sampling  scale  and  interpolation  factor  such  that  the  effective  lattice  spacing  is 
roughly  proportional  to  the  spatial  scale  of  the  measurement.  Thus  As/s  is  roughly 
constant,  where  As  is  the  spatial  resolution  and  s  is  the  spatial  scale.  The 
motivation  of  this  scaling  is  to  keep  the  total  number  of  elements  required  at  a 
tractable  number  independent  of  the  image  size. 


FIG  14 


Fig  14  is  an  illustration  of  the  scaled  lattice  model.  For  clarity  we  show 
only  the  fundamental  photoreceptor  sampling  and  a  3:1  interpolation.  Part  a)  shows 
the  external  luminance  distribution,  a  delta  function.  Part  b)  shows  the  luminance 
distribution  after  blurring,  and  c)  shows  the  sampling  of  the  image  by  the 


22 


Joy  Hirsch 
F49620-83-C-0026 


photoreceptors.  Pert  d)  represents  the  interpolation  process,  which  accepts  the 
coarsely  sampled  input  from  the  photoreceptors  and  produces  a  more  finely  spaced 
sampling  on  the  neural  lattice  (e).  We  have  drawn  the  neural  unit  spacing  as  1/3 
the  photoreceptor  spacing,  but  in  general  it  can  be  1/N  where  N  is  an  integer. 

Part  f)  illustrates  local  feature  detection  on  the  neural  unit  lattice,  showing  a 
peak  detector  (square)  receiving  input  from  three  adjacent  neural  units.  Part  g) 
is  a  possible  realization  of  a  position  independent  separation  detector  using  pre- 
counted  intervals  for  speed.  The  separation  detector  performs  the  function  Peak 
(z)  and  Peak  (z  +  s)  ORed  over  all  z,  and  would  have  many  properties  usually 
attributed  to  spatial  frequency  selective  channels  with  spatial  summation. 
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results  were  replicable  over  the  three  month  period  of  data  collection.  A 
possible  explanation  for  the  'practice  effect'  may  be  subtle  head  movements 
empolyed  by  the  observer  to  improve  performance  on  non-preferred  stimulus 
orientations.  We  encountered  snch  a  problem  and  solved  it  by  improving  head 
stabilization.  This  is  an  interesting  point  in  that  it  indicates  that 
observers  may  be  to  some  degree  aware  of  the  existence  of  optimal  orientations 
and  attempt  to  tilt  their  heads  to  exploit  them. 
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The  most  detailed  Caelli  e_t  ml .  data  is  presented  in  a  two-dimensional 
form  that  is  difficult  to  compare  to  the  data  presented  here.  However  they 
display  summary  graphs  showing  spatial  frequency  discrimination  as  a  function 
of  orientation  averaged  over  4,  8,  and  12  c/deg  which  are  coincidentally  the 
nominal  frequencies  at  which  we  expect  transitions  to  occur.  For  one  of  their 
observers  (KH,  Fig  2d)  this  function  displays  an  almost  pure  60°  periodicity 
although  it  lacks  the  even  symmetry  that  we  expect,  perhaps  due  to  averaging 
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square  components  as  is  reported  here. 
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FIGURE  CAPTIONS 

Fit.  1  Fractional  jnd  in  spatial  frequency  (Af/f)  as  a  function  of  spatial 
frequency  of  the  reference  grating  (c/deg)  for  observers  JH,  BA  and  MM.  The 
straight  lines  passing  through  the  origin  represent  regions  of  constant  angular  jnd 
As.  Determination  of  the  lines  is  discussed  in  the  text. 

Fit.  2  Fractional  jnd  in  spatial  frequency  (Af/f)  as  a  function  of  field  sixe 
(nnaiber  of  cycles  in  the  reference  grating)  for  observer  BA  at  4,  8  and  12 
cycles/deg. 

Fie.  3  Fractional  jnd  in  separation  (As/s)  as  a  function  of  1/reference 
separation  (deg -if).  The  straight  lines  passing  through  the  origin  represent  the 

regions  of  constant  angular  jnd  Aa  shown  in  Fig.  1. 

Fia.  4  Comparison  of  spatial  frequency  discrimination  (4a)  and  line  pair 
separation  discrimination  (4b)  for  observer  JH.  The  data  from  Figs,  la  and  3  are 
replotted  (Fig.  4a  and  4b  respectively)  to  show  the  similarity  between  the  two 
experiments  as  discussed  in  the  text.  The  dashed  lines  drawn  through  the  data  in 
both  cases  are  the  same  as  the  lines  drawn  through  the  origin  of  Figs.  1  and  3. 

The  data  illustrate  the  atep-like  characteristic  of  As  for  both  experiments.  Open 
circles  show  similar  line  pair  separation  results  previously  reported  by 
Vestheimer.2/ 

Figure  3  Cone  inner  segments  at  the  central  fovea  in  the  retina  of  the  monkey. 
Macaca  fascicularis.  shown  in  a  photograph  of  a  1  |tM  thick  section  tangent  to  and 
on  the  sclera  side  of  the  external  limiting  membrane.  Center-to-center  distance  of 
cones  is  3  |iM.  From  Miller  (1979)  with  permission. 

Figure  6a  Histogram  of  distances  between  all  pairs  of  photoreceptors  in  the 
sample  shown  in  Fig.  1.  The  first  peak  shows  the  distribution  of  distances  between 
the  centers  of  nearest  neighbors. 

Figure  6b  Histogram  of  all  angles  between  the  horizontal  axis  and  the  lines 
connecting  the  center  of  each  photoreceptor  to  the  center  of  its  nearest 
neighbors.  The  six  peaks  demonstrate  a  high  quality  hexagonal  lattice. 

Figure  7  Variance  between  expected  and  actual  positions  of  photoreceptors  vs. 
ring  number  normalized  so  that  the  nearest  neighbor  distance  is  1.0.  Filled 
circles  correspond  to  errors  in  separation  (parallel),  and  open  circles  correspond 
to  errors  in  orientation  (perpendicular).  The  curve  is  a  psychophysical  estimate 
of  the  total  parallel  variance  in  spatial  interval  measurement  by  humans. 

Figure  8  Fractional  jnd  in  spatial  frequency,  Af/f,  where  Af  is  the  jnd  in 
frequency  and  f  is  the  reference  frequency,  as  a  function  of  orientation.  0* 
represents  the  vertical  (bar)  grating  orientation.  Functions  are  shown  for 
observer  SC  for  a  reference  frequency  of  4.0  c/deg  (la)  and  for  observer  JH  for  a 
reference  frequency  of  4.3  c/deg  (lb). 

Figure  9  Jnd  in  offset,  Ao,  for  the  vernier  offset  discrimination  task  as  a 
function  of  orientation  where  0*  represents  the  horizontal  orientation  of  line 
segments.  Functions  are  shown  for  two  observers  SC  and  JH  with  a  gap  of  .23  deg  in 
the  vernier  target. 
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Fiaure  10  The  decomposition  of  orientation  dependence  into  hexagonal  and  square 
components  for  the  spatial  frequency  discrimination  task  (upper  sections)  and  for 
the  vernier  offset  discrimination  task  (lover  sections).  Center  plots  in  each 
quadrant  show  the  sum  of  hexagonal  and  square  components  plus  the  data  replotted 
from  Figs  1  and  2  (minus  the  average).  Note  that  0*  rotation  is  a  vertical  spatial 
frequency  grating  (top  graphs)  and  a  horizontal  vernier  line  segment  (bottom 
graphs). 

Fiaure  11  Fractional  jnd  in  spatial  frequency.  Af/f,  as  a  function  of  reference 
frequency  for  observer  SC.  The  data  show  a  sharp  transition  between  3.S  and  4 
c/deg.  This  effect  has  been  previously  described^.  The  dashed  lines 

illustrate  the  use  of  the  transition  to  magnify  an  anticipated  small  hexagonal 
orientation  effect  as  discussed  in  the  text. 

Fiaure  12  Results  of  the  line  grating  frequency  discrimination  experimenta  for 
spatial  frequencies  between  0.3  and  2  c/deg.  The  fractional  jnd  in  separation  As/s 
is  plotted  against  the  inverse  of  reference  separation  which  ia  dimensionally 
equivalent  to  spatial  frequency.  Data  are  shown  for  four  observers:  GC.  CS,  SC 
and  SG.  The  slopea  of  the  straight  lines  drawn  through  the  first  segments  are 
0.039,  0.034,  0.033,  and  0.030  deg  respectively  and  the  family  of  lines  drawn 
through  the  data  are  explained  in  the  text. 

Fianre  13  Results  of  the  sinusoidal  grating  frequency  discrimination  experiment 
for  spatial  frequencies  between  1.3  and  28  c/deg.  The  fractional  jnd  in  frequency 
Af/f  is  plotted  against  reference  frequency.  Data  are  shown  for  observer  JR,  and 
the  slopes  of  the  line  segments  fit  to  the  data  are  indicated  on  the  graph.  (The 
region  of  this  graph  below  16  c/deg  has  been  published  previously.!) 

Fiaure  14  Schematic  of  the  scaled  lattice  model.  See  Apppendix  A  for 
discussion. 
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Figure  $ 
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SPATIAL  FREQUENCY  DISCRIMINATION 
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Figure  8 
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VERNIER  OFFSET  DISCRIMINATION 
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DECOMPOSITION  OF  ORIENTATION  DEPENDENCE  Figure  10 
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Figure  11 


SPATIAL  FREQUENCY  DISCRIMINATION 


REFERENCE  FREQUENCY  (c/tf*Q) 


Eipecied  Onewotiop 
Dependence  of  Af/f 


ST 

\ 


Joy  Hirseli 
F49620-83-C-0026 


LINE  GRATING  DISCRIMINATION 


Figure  12a 


M 

55  003 


Observer  GC 


I  I  I  I  I 


2.2  24  2 


0.2  04  08  0§  1.0  1.2  1.4  1C  1C  20  22  24  2C  2.0  SO 

Referenct  Seporotion"'  (dec"') 


jam 


41 


Joy  Hixsch 
F49420-83-C-0026 
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Variance* 

Pncorrected 

parallel 

perpendicular 


TABLE  1 


Paraaeters  of  Beat  Fit  Lines 
Variance*  vs  Ring  Number 


Slope 

Intercept 

X2 

df 

Conf , 

,0056+. 0002 

.0001+. 0006 

8.89 

6 

.18 

,0075+. 0003 

.0021+. 0009 

2.60 

6 

.86 

*Variance  is  expressed  in  units  of  aean  inter-neighbor  distance  squared. 
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TABLE  II 

Fits  to  Modsls  of  Orientation  Dependence 

Orientation 


Observer 

Dependence 

X* 

df 

conf 

Spatial  Frequency 

SC 

none 

69.5 

24 

3xl0_< 

Discriaination 

(4.0  e/deg) 

hexagonal 

33.9 

21 

.037 

square 

67.0 

21 

lxl  O-^ 

hex+sqnare 

26.5 

18 

.088 

JH 

none 

40.7 

17 

.001 

(4.5  e/deg) 

hexagonal 

22.7 

14 

.065 

square 

33.0 

14 

.003 

hex+square 

13.4 

11 

.270 

Vernier  Offset 

SC 

none 

139.0 

20 

<io-10 

Discriaination 

hexagonal 

57.5 

17 

3xl0~6 

square 

96.3 

17 

<io-10 

(gap  *  .25  deg) 

hex+equare 

17.9 

14 

.210 

JH 

none 

161.3 

23 

<io’10 

hexagonal 

66.6 

20 

7xl0~7 

square 

125.1 

18 

<io’10 

hex+square 

18.4 

15 

.240 

|C» 


»CV 
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